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Chapter I: THE PROGRAM 

Remedial reading instruction was providad for 776 students at 
5 sites in 4 high schools. There was an evening program at 1 high 
school. Initiallyp the participating economically and educationally 
disadvantaged students were expected to meet either of the following 
criteria: (1) January or June 197S graduation with a certificate 
Instead of a diploma^ or (2) entry of the 10th, 11th or 12th grades 
in September 197S with reading achievement below the 8*0 level as 
measured by a standardiEed test. The second criterion was modified, 
hotfever, to Include only students entering the 11th or 12th grade 
with reading achievement below the 8,0 level. Qualified students 
were enrolled primarily on the basis of referrals from their high 
schools, with voluntary enrollments by students and enrollments 
through recommendations by teachers. 

The purpose of the program was to' help the total group of 
students perform at .a significantly higher level on the standardized 
reading test on the posttest, and to help 70% of the students at one 
site achieve mastery of an instructional objective which they had 
not mastered on the pretest. The primary goal of the pupils ^ how- 
ever, appeared to be to achieve on an 8.0 level by the conclusion of 
the program. 

17 experienced and well qualified remedial reading teachers were 
recruited, together with 17 aides. Quantities of appropriate read- 
ing materials were purchased, and the principals, reading coordina- 
tors and supervisors of the site schools were requested to make 
available specified reading materials through the summer school 
general assistant* The reading program itself appeared to be 



carefully planned and supervised. Prior to the July i, 1975 train- 
ing session and first day of school the following correspondence was 
sent to the indicated individuals: 



Date To 

S/7/7S TIC of Title I Summer 
day and evening H.S, 



S/22/7S Principals of H.S. 



S/23/75 TIC of Day, Bvening H.S 



S/29/7S Principals of Title I 
site schools 



6/9/75 H.S. Principals 
6/13/75 Selected students 

6/19/75 TIC, General Assistants 



Subje ct 

Time and place events ef the sum- 
mer program, materials and 
equipment 

Request for cooperation on the 
Special Application Form for 
students j 

Special Application Form for 
students 

Request for the use of Title I 
labs and reading materials in the 
summer program 

Revised list of sites and criteria 

Notification/request for acknowl- 
edgeraent; site of training session 

Assignments of teachers, parapro- 
fessionals, lists of materials 
ordered for the summer program. 

At the July 1 training session, each teacher received, a shopping 
bag (with the teacher's name on it) containing the following 
materials: MAT Ceverything needed), profile sheets, taxonomy, guide 
to grade level materials, mini -taxonomy , materials guide, assignment 
sheets, uniform answer sheets, conversion tables, student interview, 
independent reading record, folders, and blank cassettes. The 
coordinator gave an overview of the program, reviewed all activities 
including classroom, MAT and evaluation, and introduced all person- 
nel including the consultant-evaluator. 

During the program, each teacher was visited at least once 
weekly, usually by the teacher trainer. These visits served: as both 
supervision Cgoal clarification, individualization, use of 
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materials) and administration/problem-solving. There were 29 . 
teacher sessions from July 1, 1975 to August 8, 1975, one o£ the 
last days being a double session Ctesting^ scoring, recording) 
and 27 student sessions, July 1, 197S to August 7, 197S. Each 
class was 90 minutes long, and class size was approximately 15 
pupils. ' 

Chapter II: EVALUATIVE PROCBDURES 

The overall purpose of the evaluation was to determine product 

and process effectiveness for the program within the context of 

the project proposal and evaluation design. Product effectiveness 

was measured through ^*hard'' data on student pre/post achievement 

on a standardized test. - Process effectiveness Included the rela- 

tionship between actual and proposed program activities together 

with certain other qualitative data and was measured through site 

visits and teacher filled out questionnaires. 

Evaluation Objectives 

Evaluation Objective #1 : To determine whether, as a result 
of participation in the Remedial Reading Program, the read- 
ing grade of the students will show a statistically signifi- 
cant difference between the real post-test score and the 
anticipated post-test score, 

NOTE: This objective was modified, as specified by the fol- 
lowing quote froni the memorandum of June 16, 1975 from Dr, 
Anthony J. Polemeni to, Mr, Milton Schleyen: 

. , . a correlated t test will be applied to determine if the 
difference between pre/post test grade equivalent means is statis- 
tically significant*-' 

All students in the program were given the following batteries 
®f the Metropolitan Achievement Test , Advanced level: Word Knowl- 
edge and Reading Comprehension, Form H was given as the pretest 
during the first week of the program (J^ly 1 ^ S) and Form F was 
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given as the posttest during the last week of the program (August 

S) . The tests were scored by the teachars and entered as grade 

equivalent scoras on the data collection form. Of the 776 students 

for whom names were entered on the data collection forms ^ pre and 

post test scores were available for 635, The breakdown on the 

discrepancy between total N and number tested is as follows r a 

total of 158 students were absent from post test, 100 or 72,51 of 

whom were discharged or had withdrawn. 3 non-English speaking 

students were not tested on either or both pre and post test. 'Of 

the 635 students for whom pre and post test scores were available , 

only 36 or 5*6% had attendances of less than 7S1. 

Evaluation _ Objective #2 : To determine if, as a result of 
participation in the program^ 70 percent of the partici- 
pants will demonstrate mastery of at least one instruc- 
tional objective J which prior to participation in the pro- 
' grm, they did not master (exploratory; not part of evaluation), 

, All students in the program at Theodore Roosevelt High School 

were administered a criterion referanced test (CR^TO developed ' 

by SRA on a pre/post test basis during the second (week of July 7- 

11) and last (week of August 4 - S) week of the program. There 

were 5 areas covered, phonics, structural analysis, comprehension, 

vocabulary and study skills, with 3 objectives for each area (IS 

objectives) and 3 items for each objective. The pretest was to 

have been given during the first week of the program, but a miscue 

in shipping resulted in the test being delivered to the teachers 

during the second week. The tests were scored and recorded by 

program personnel in the pass/fail mode (pass was defined as 3 out 

of 3 correct) by pupil and instructional objective on the Class 

Evaluation Record CC-E,R,) provided by the Office of Educational 

Evaluation, Data relevant to the evaluation objective were 
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stumarized from the C,E,R. Complete pre/post test inforination was 

available for 146 out of the 160 students for whom pretest scores 

were recorded. Of the 14 pupils absent^ 11 had been discharged 

prior to the posttest* 

Evaluation Objective #3 i To determine, as a result of par- 
ticipation in the program, the extent to which the pupils 
demonstrate mastery of instructional obj ectives CExploratory) . 

The evaluative instrument, dates of the evaluative procedures, 

scoring and summarization are the same as for Evaluation Objective 

Evaluation Objective #4 : To determine the extent to which 
the program, as actually carried out^ coincided with the 
program as described in the Project Proposal. 

Two evaluative instruments, an observer checklist and a teacher 
questionnaire, were developed with regard to this objective. 
These were developed following a study of the program proposal and 
evaluation design, interviews with the program coordinator and 
teacher trainer on July 1 and 2, and attendance at the teacher 
training Corientation) session on July 1. ' 

In summary, the program was to offer rather intensive attention 
to the variety of reading problems which this particular group of 
students could be expected to present. The time available was 
rather limited* The teachers and educational assistants would 
have to be competent and have the necessary materials as of the 
beginning of the program. The evaluative Instruments were develop- 
ed so as to measure on the basis of the following criteria: compe- 
tent teachers Ce^P^rience plus training) , adequate physical facili- 
ties and materials, teacher planning and evaluation with respect to 
individual diagnosis, ptescription and remediation, the use of 
appropriate word attack skill tasks, comprehension skills, 
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interpretation, reading rat© activities ^ independent use o£ 
materials, rapport with students, and ready access to and regu- 
lar consultation with the High School Reading Office. Site 
visits were made on July 9, 28, 29 and 30, 1975. During the 
site visits, each teacher .was observed and the observations 
recorded on the observer checklist. 2 teachers were not observed 
teaching per se , as they were administering the C.R,T* which had 
arrived late. The teacher questionnaire was given to the teach- 
ers during the site visits and were mailed in, anonymously, by. 16 
out of the 17 teachers. An additional check on teacher planning 
and evaluation was an examination of the individual student 
folders and the teacher- s response to the gtfneral. question of 
*'how do you determine what assignments to make for this student?" 

Chapter lUi FINDINGS 

In the first section of this chapter, findings are presented 

with respect to the objectives specified in the evaluation design 

as measured by the evaluative procedures described in the previous 

chapter* The following sactions Include a description of the 

adequacy of facilities and materials, a discussion of the extent 

to which the program serviced the needs of the specific target 

population for which it was designed and implementation of the 

recommendations from the last prior study. Because of the cutbacks, 

there was little need to Integrate with other district programs. 

; Evaluatlon Objective #1 > To determine whether, as k result of 
, participation in the Remedial Reading Program, the teading 
grade of the students will show a statistically significant _ 
difference between pre/post test grade equivalent means through 
the correlated ^ test methodology* i 

Findings shown in Table 1, following, indiWte n significant 

gain in achievement for students in the program. Findings for 
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total scoras only are reported in the MIRi findingi for pupil 
achievement on the subscalss o£ word knowledge and reading com- 
prehension are also included in Table 1, With rather striking 
gains during the program of 9, 8 and 8 months, all significant 
at the .001 level, the students' achievement tmequi vocally met 
the first objective. This component shauld qualify as an 
exemplary program. - - • - 

TABIB 1 

COMPARISON OF PUPIL PRE/POST GRADE ' EQUIVALENT 
^fflANS ON THE METROPOLITAN ACHIEVEMENT TEST 



Sectidn 


Pretest 
H SO 


PoSttest 
M SD 


t 

varu© 


d£ 


p less 
than 


Word Knowledge 


6, 1 


I. ? 


7. 0 


1.9 


IS. 1 


834 


,001 


Reading 
Comprehens ion 


S. 9 


i, a 


B. ?_ 


8. 0. 


8. 8 


634 


. 001 


Tbtal 


8, 0 


1, 8 


8, 3 


1,8 


25. 5 


834 


. 001 


Evaluation Oi 


jjective #2: 


To 


determine if., 


as a result of 



pants will demonstrate mastery of at least one instruction- 
al objective, which prior to participation in the progrm^ 
they did not master. 

As indicated in Table 2, followingi 70. St of the participa- 
ting pupils actually mastered two of the instructional objectives 
on the posttest which they had failed on the pretest. Since 
85t6i of the pupils mastered one objective on the posttest which 
they had failed on the pretest p the second objective was also 
met. 

T^LE 2 

DrSTRlBUTION OF PUPIL PRE/POST FAIL/MASTER 
ON INSTRUCTIONAL OBJECTIVES 

No. of objectives Cumulative Cumulative 
fail/master No. of no. of 1 of 

pre/post students students students 



IS 11 0,71 

14 * - 0 1 0.7 



Table 2 con t iraie d 



No* of objectives ~ ^ ^ Cumulative ~ cumulative 
fail pre/ No, of no. cf I of 

master post students students students 



13 


0 


1 


0. 71 


12 


0 


1 


• 0,7 


11 


0 


1 


0.7 


1 U 


0 


1 


0.7 


9 


2 


3 


2.1'. 


8 


2 


S 


3.4 


7 


7 


12 


8.2 


6 


9 


21 


14.4 


S 


15 . 


36 . 


24.7 


4 


26 ' 


62. ■ 


42.5 


3 


16 


78 • 


53.4' 


2 


25 


103 


70.5 


1 


22 


125 


05.6 


0 ■ 


21 


146 


100. Ot 



ByaluatiQg, Objjctive #3 ; To deteriaine, as a result of par- 
ticipatiorr In tlie prSgrain, the extent to which the pupils 
demonstrate nastery o£ the instructional objectives (exploratory). 

The findings shown in Tables A and B, follpwing, indicate that 

a relatively small number of pupils demonstrated either all or none 

mastery and that most of the pupils were clustered in the mid-range 

of pretest raastery/failure . 

TABLE A 

DISTRIBUTION OP PUPIL NON-MASTERY ON PRETEST 
AND NO POSTTEST FOLLOW-UP 



Number of Ins tructio^al Number of " ' Percentage of 
Obj ectives Failed Pupils Pupils 



9-10 . 27 • 16. SI 

7-8 46 28.0 

S-6 35 21.3 

3-4 18 , 11.0 

1-2 2 1.2 

0 1 . 0.61 



TABLE E 

DISTRIBUTION OF PUPIL MASTERY OF INSTRUCTIONAL 
OBJECTIVES PRIOR TO INSTRUCTION 



Fercentage of Mastery of Number of Percentage of 

Instructional Ob J ectives Pupils Pupils 

75-1001 13 ~~ ' 8.11 
51-75% 70 42.7 
26-SOt 57 35.6 
O-ZSI 23 . . 14.4 



^nas not Tnfnr fn Tniipil non-nastery of 11+ objectives. 
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The findings shown in Table C Indicate which instructional 
objectives were attempted and mastered by various" numbers of 
students. The assunption for the following discussion is. that if 
an instructional objective was not entered in the "skills not 
covered" colunm on the class evaluation record for the CRT/ the 
teacher had taught (and the student had attempted) the objective. 

TABLE C 

DISTRIBUTION OF PUPIL MASTERY BY INSTRUCTIONAL OBJECTIVl 
AS A RESULT OF INSTRUCTION* 



ctlSe*^ f-P " P ils achieving mastery ^flT<-«r.i-.g, 
— — » pupils attsmpt igg mastery of Mastery 

I 19/14S 13.11 

I 36/134 26 9 

I ■ 11:5 

Z 23/146 IS o 

! 26/146 i7i 

5 40/146 . 27*4 

I 32/146 21:9 

q 29/146 19.9 

34/146 23 3 

J? 15/146 

H 10/146 6 8 

II 42/113 2i:i 

II . 33/146 . 22.6 

IB if'^"2 31.3 

— 32/135 23.71 
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Objectives 1, 4-11 and 13 were attempted by 9SI or more of the 
students, while objectives 12 and 14 were attempted by only 771 of 
the pupils. The success rates were much lower, however, with most 
of the ratios of mastery over attempted being in the 20-291 ruige. 
Of the objectives in which the success ratios were the highest, 
only objectives 9, ln-=rence, and 13, book organization, were 
among the objectives attempted by most of the students, it would 
appear that although most of the objectives were attempted by most 
of the pupils (and teachers), only some of the objectives were 
mastered by some of the pupils. 

* InmhL^ refers to pupils attempting, as defined above, not total 
number passing/falling. 

. 12.. 
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The findings shown in Table D parallel those shown in Table 2. 
Most of the pupils mastered but a few of the instructional objec- 
tives, 

TABLE D 

DISTRIBUTION OF THE NUMBER OF INSTRUCTIONAL OBJECTIVES 
MASTERED AFTER INSTRUCTION 

fJuBiber of instructional Number of Percentase o£ — 

nH^ectives Mastered Fupils , 7upils 



, If. 1 0.71 

13-14 . 0 0.0 

11-12 0 0.0 

2 1.4 
n 5 6.2 
f"f 24 16.4 
f-J 42 28.8 
1-2 47 32.2 
2 21 . • 14.4 



With regard to the data illustrated on Table B, each pupil for 
pre/post data are available took the complete CRT and all ' 
pupils could therefore be described as having attempted all objec- 
tives. However, since data on the class evaluation record indi- 
cate that some objectives were not covered with some, students, the 
nimber of objectives attempted was defined as the number of objec- 
tives failed on the pretest, less the number of objectives not 
covered by the teacher. 

Consequently, the number of objectives actually attempted by 
each pupil varied, but tended to be rather low. A frequency di's- 
tributlon of the numbers of pupils attempting from all to none of 
the objectives is not indicated on the table, but the range was 
from 1-13, with a median number of objectives attempted o£ 7, 
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TABLE E 

DISTRIBUTION OF PBRCBNTAGl OF PUPILS ACHIEVING VARIOUS* 
LEVELS OF MASTERY OF INSTRUCTIONAL OBJBCTIVES 

Percentage of Mastery of —^^—5 - ' 

Instructional Objectives 

# Obdeaiiveg Aahievjd Number of Percentage of 

if Obiestivma Attempi^S . 1 Pu-plls Pupils 

6 4.11 

9 6.2 

9 6.2 

21 14.4 

30 20. S 

IS 10.3 

10 6.8 

14 9.6 

12 8.2 

20 13.7 

In summary, pupil mastery tended to be of a subset of the 
instructional objectives, clustered around SOI, whether the ratio 
was 5/10 or 1/2. 

Evaluation Objective H t To determine the extent to which 
the prog ram 7 as actually carried out, coincided with the 
program as described in the Project Proposal. . , 

The Observer Checklist CAppendlx A) and the Teacher Question- 
naire CAppendix B) were developed so as to measure the program as 
described in the Project Proposal and modified as a result of the 
budget crisis. The findings shown in Tables 3 and 4 Indicate 
that the desired qualities were present in the classrooms and be- 
haviors observed, with the exception of= the materlala requested 
of the site high schools. One of the project coordinator's goals 
was to recruit competent teachers, and the observed teacher plan- 
ning, evaluation and teaching certainly approximated the qualities 
envisaged by the proposal. Class sizes were approximately IS, 
with. the indicated activities taking place on an individualized 
basis. The teacher trainer or project coordinator visited each 



90-1001 
80-891 
70-79t 
60-691 
S0-S9I 
40-491 
30-391 
20-291 
10-191 
0-9i 
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teacher at least once weekly and the only discrepancies from the 
proposal were the revised selection criteria and the problem with 
securing materials front the host schools. The progran was observed 
to coincide with the description in the project proposal. 

Adequacy of facilities and materials . Facilities were rela- 
tively , adequate. As indicated by item A on the Observer Checklist 
CAppendix A) , the following qualities were observed for all 17 
classrooms: size of area adequate, space available for small group 
work, space available for individual work, storage facilities 
available, chalkboard available, area attractive and adequate 
physical provisions (light, ventilation, etc.). The median overall 
rating of facilities was 4 on a S-poiat, Likert-type scale. With 
regard to materials, however, the picture was somewhat mixed. On 
item B, Materials, a majority of materials specified to be left 
for use was not available for the teacher for 16 out of 17 class- 
rooms although the materials ordered for the summer program were 
available for 14 out of the, 17 classrooms. The median overall 
rating of materials was 4 on a S-point scale. Items 13 through 16 
on the Teacher Questionnaire also relate to materials. 14 out of 
the 16 reporting teachers described the supply of materials as 
adequate, the median rating being 4 on a S-point, Likert-type 
scale, although 14 out of the 16 teachers reported supplementing 
the prescribed materials with materials from other sources. Only 
3 of the teachers described themselves as having found it necessary 
to create their own reading materials. The materials and labs 
observed in use were appropriate for the program (labs such as 
R.F.U., S.R.A., E. D.L.I paperbacks. Dally News, games). It would 
appear, however, that the High School Reading Office did a much 

15 
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better job of supplying the teachers with materials than the host 
schools. Facilities and materials were concluded to be adequate. 

Needs of t he target popuratlon . It would appear that there 
were two needs for the target population, first, to attain an 8.0 
in reading achievement, and second, to attain a higher level of 
achievement in reading. As indicated by the mean pre/post MAT 
scores, the population scored well below grade level in reading 
achievement, and did demonstrate significant gains. Individual- 
ized instruction was used throughout, and student assignments/ 
records in folders were related to specific needs (speed, compre- 
hension, vocabulary, etc.); Of the 63S students for whom pre/ 
post information was available, 140 or 22t actually attained an 
8.0 level or higher who had not attained 8.0 on the pretest. This 
program does appear to be serving the needs of the target popula- 
tion, and did meet an important need for a significant percentage. 

Implementation of ^recommendations from last prior study . 
There were 7 recommendation's from the last prior study. These are 
discussed in sequence, beginning with the first. 1. Seek to 
recruit s uperior reading taachers : on the basis of the observed 
results, it would appear that superior teachers were selected. 
Data from items 1-S on the Teacher Questionnaire Indicate that the 
credentials of the teachers were good, e.g., 2 were at the B.A. 
level, S at. the M.A. level and 9 at the M.A.+ level, although only 
2 had had a major in reading; most reported specialized training, 
median years of experience in teaching reading of 5 years in high 
school, 6 years in junior high school and S years in elementary 
school with considerable other exporience In teaching reading. 
■Appropriate items oh the Observer Checklist were items B. Teaching 
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Procedures, F. Teaching Behavior and Pupil Participation* The 
teaehers were observed to be using the desired procedures and 
exhibiting the desired teacher behaviors and the pupils i^ere ob- 
served to be exhibiting the desired behaviors, with median ratings 
of 4 on a 4-polnt scale for all ratings. One frequent suggestion 
by the teachers^ however, was to employ experienced paraprofesslonals 
2* Set up c alendar and guidelines in June at home schools ! This 
racommendation was also implemented, as indicated by the summary 
o£ correspondence in Chapter I. Correspondence with the home 
schools relevant to the recommendation actually began May 7, 3» 
Seek a pre-selection prQcess^ithrough school year for graduates and 
juniors reading below 8,0 to prepare .their summer enrollment i There - 
is no data bearing directly on this point, but there appears to be 
less than optimal cooperation with the high schools, for example, 
the specified reading materials were not shared. Without referring 
specifically to this point, during the July 2 interview with the' 
program coordinator it became evident that the high schools typi- 
cally do not presently send the requested supportive data for each 
enrollee* 4* Establish a uniform credit system for reading : Dis* 
cussion continued; the recommendation appears to be somewhat out* 
side the scope of a summer progrM^ S, Seek to eliminate 
necessity for "doubling up*' by providing backups for imfnediate 
replacement for sick staff : Substitute time was provided for in 
the budget; one aide absence was observed without a substitute* . 6, 
Try to eliminate over-testing : All tests given were SBD require- 
ments* 7i Materials need to be in place before program starts ' 
This issue has been discussed earlier. The only materials not in 
place on timr were the materials to be supplied by the host schools 
and the CRl . 

17 
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Chapter IV*. SUJ&IARY OF MAJOR FINDINGS, CONCLUSIONS 
AND RECOmiNDATlONS 

w 

Suimary 

Three major overall events were noted/ First , the pupils In 
the program were observed to demonatrate rather striking achieve- 
ment^ with 225 actually attaining the desired 8.0 in reading 
achievement. Second, with regard to pupil mastery of objactives"^ 
while the objective of 701 of the pupils attaining at least one 
objective was met, actual mastery was of a subset of the total 
number of objectives. Third , the program coincided with the 
description in the proposal* 
Conclusions 

1* The summer program, personnel were highly competent, with the 
possible exception of lack of experience hindering the per^ 
formance of some of the paraprofessionals . 

2, The program needs more experience with CRT before useful 
expectations can be specified in an evaluation design,. 

3. The summer program needs more cooperation from the sending 
high Bchools. 

4t Title I money was well invested in this program. 
Recommendations 

1, The program should be refunded and further supported Caddition- 

al materials; i-ncreased cooperation with the high schools) if 
possible. 

2p a mechanism should be developed Cco^P^t^^cy-based certification 
would be one possibility) to facilitate the selection and 
employment of reading personnel as competent as the observed 
staff. 

3. The M,A,T. which is given pre/post is not a diagnostic test, 
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-16- 

aithough the s.taff was able to so use it on a lljaited basis. 
The us4 of a diagnostic prs/post test would have tha same 
instrumant serve both an evaluative and diagnostic function 
and is raconmended. 

Paraprofessionals experienced in remedial reading should be 
salactad (the aides observed were conscientious j for the short 
duration of the progrM, however ^ there was not really time 
for them to learn) . 



19 



Reiaedial Reading Skills, Umbrella I, Suminer, IIU ' 
Function Number: 0^61613 

Use Tible 28 for norn rifireneod achlev^int dala ooC appUcabli to fabli 26, (Sir ningtrueeions" Itm 5 before 

«OBpiiti!ig ehii uble.) 

28i StendicdUd TiSt imlU 

I. 

\ 

In the table bilow^ antit the riquiated assissmnt Inforaatioa gbmt thi testi uied Eo ivaluati the effegt- 
iveneie of major project caspenenti/activicles in achiiving disirid objistivis. Befofi eoBpUting this fon, ^ 
read all footnotea. Attach additional aheets if neeegsary, 




1/ Wintlfy test used and yait of publication (lttT*58; CAT*70, 
eie.) 

ll Total nuinbec of pirticlpti In the aetivlCy. 
' 3/ IdanHfy tlii partlcipantg by ipiElflc grsdi livel ^ 
grade 3, grade j). ^hirg siverAl gradoi art GOibined, 
enter the last two dl|tEi of the cottponint code, 
4/ Total nuinber of parclelpaitci included In the pre and 
poittest calculations, 
' 5/ I ^ gfidi iqijlvilint; 2 ■ percentile rank; 3 ■ z score | 
4 " Standard score (pubUahdr'g)! 5 ■ itanine; 6 ■ raif 



II ID ^ Standard Diviatkn 

ll Test itatlstiei (i.i., t\ P;J^), . 

1/ ObEsinid value ■ 

jj Irovlda data for the foUouing groupg sipfiriteljri 
NeglecEed (code a K), DeliApM (eodi ia Q)^ 
and Handicapped (code as K), Plsci the in- 
dieatid code letter in the lait eoluaa to 
sipify the aub|reup ivaluitedi 



2er|c 
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$0. Cfitirioa lififittiid tesE liittUii In thi Ubli feelotfi %mi thi laqufgCid lofAKsitloA abuut gciterimi 
immi tm tm\t% yid to eviluaN thi illieUvioiii of fbore ^raiEiiAli (Ug§ thiti 60 houra) lo readin| 
or uehiiuci». Uie ehi iaiemCloMl objiellve eodii pcovidid oa pp.N si th« instcuQCion manual. Icovidi 
Aftly thou iof ccyctloDal objectlvi codii uhicb vin addffiied hf tbi ttifiaine ud providi eipantg data loj?^, 
Mch CMC uad ud iicb livil Niiid. Via iddlliwii ihiili il mmtft imU ia eolumi 2, 3 and 4 orilf 



those parElci^QU who coiplaEed both teaHi bpitritori puipMy baly* Hot pivt of ivgluacioni Irlk ColilBi • 

' eoniulttot'iM' 

- . — ■ — - ^ - I I fii I I I I ■ - , ■■ 1^ - - 



• 

:Cods 


lulrueEloui 


fubliihir 

■ 


ImL 


1/ 


■r . 


Frit 
Jo. oi 

Filling 


eat 

Npiii 

FailiRg 


fog 
Ns, o! 
FiipiU 
ffOi 
Col. 2 
Fasaini 


etiit 
Ho, of 
Fupili 
>froi 
Col. 2 
,FailM 






2102 


Bi|lBalii| cosiOQi 


m ^ 




§0811 


-.LT!/->"F.nr 


111 


27 


19 
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2106-? 


iMg vweii 


m 


tt 


N 


.. 


80 


66 




3D 


2105 


laUiil blesda 


N 


II 


11 


- - 1 - - 


n 


74 


37 


,3? 


2201 


Cs^ound vordi 


H 


if 


If 




106 


40 


23 


17 


2202 


G&ktrictleui 




N 


tt 




m 


45 


26 


19 


2204 


Ffifiiii 


M 


II 


N 




83 


63 


40 


23 


2404 


DiUlli 


H 


n 


N 




» 


71 


32 


39 


2406 


Hila Idii 


n 


n 


N 


... ■ 


34 


112 


29 


83 ' 


2403 


laferente 


N 


If 


II 




42 


124 


34 


90 


2304 


S^on^ 


n 


n 


If 




18 


-28 


15 


13 


2501 




« 


N 


N 




32 


.14 


10 


4 


2503 


Geopiphy 


n 


H 


II 




|i 


lis 


42 


73 


•1501 


Boole orpnliacl&n 


It 


H 


11 






102 




69 




■Mdi^wiftii 


if 


i 


N 




44 


102 


35 


67 



1/ ladlcili Ebe coBponinE fiodi%d In piff^ui iieeUiil»lth£8 Mpwt uMd l§ digtfslbi criatMAC and popuUtleft, 
92 S Pwvidi data fof thi foll«fln| iwupi NpiriEilyi Ifeilietid (coda ia iO, StUnqMat (codi y D), BiUB|iiil 
o " . code ag B) and Hindicappid (code y H), Flaw the iBdifiiN eodi latEir in Ebi laiE wIum to ilplfy Ihi 
ERXC itigcpyB ivalusEidi 



% mmm Rififincid Teit RiiuUsi In thi table below, mnt tk tmntii infowatloii akw efitirlofi ri- 
, firincid tiiE risulta uiid co evalmte the fiffietiviniss of aiiort treatienta {Urn than'ao houri) In ridini 
Of Bathesatiei. ilii thi iaitetlonil objietivfi codis pmidid on iip.24 ef ths iflitfyetioa laifiual. Pmldi 
only theie iMtfuetisnil objeetlve eodai vhlch vera iddniied by ihi ftiatosi and imik eepnti dau fot 
each tggE uiid and lach level .tiiNd, Usi idditlomj abietijlf oieeuarj. ImH In eclipa 2, 3 «nd 4 onl? 
thoie piFtkipanu vho coipliN boib leau. ^^^^'^^ Pn^^M poft d wimk, Wlk cStliBi • 



Cede 


insEEuctional 


Fybliihcf 


liiVel 


T 7 \ 


Sulgfoop 
1/ 
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U IndleiEi thi coaponint codi uged in peivloua aegllonaolthii fiport uied to dei€Eihe trtatiBint aod popuUcido. 
II FEovldi daia for thi follwlni groupi aipaMtilyi iegleglsd (eddi as ^, fiilinpnt (sode u D), Blllii|ual 
code it B) and Handieappid (eode ai H). Plici thi Indicatid ^fldi laEtir la £he laiE tioluiD to liplff tha 
subgroup evaluated. ' 
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. SHS»IRP 
. , Unib 1 

' Oba .' Checkliat i 
I'age two 

Teaching Procedures NA. » 2 , "^^^ 

1. Use of individualized approach in reading class 

I. hvidence of folder or contract system in use -ff 

3. Teacher working one-to-one with studejits as needed ~Te ■ 

4. Weekly report on student progress by teacher or ' 

student _. — ^ 

5. Variety of simultaneous reading activities is evidence 4i 
5. Immediate reinforcement of success -- 

7. ' Specific skill teaching in 

a. Phonetics, structural analysis, decodine 75 

b. Context clues -w 

c. Word study -4t 

8. Specific skill teaching in comprehension skills and ~~ 

interpretation L . . . 

9. Specific skill teaching in reading rate, e.g. — 

a. Application of appropriate rate ig 

b. Increasing reading rate ....... — r— 

10. . Exercises differentiated to include various types of 

meanings --literal, interpretive, critical evaluation is 

11. Grouping of pupils Csmall group or individual) for ■ ~" 

special needs — jg 

12. Procedures appropriate to maturitv and ability of ~~~ 

pupils jg 

1?. Use of class time: pacing, variety of activities ---- TJ 

Overall Rating of Teaching Procedures 12 3 4 

F. Teaching Behavior ' 0 0 3 IB 

1. '. Appears enthusiastic - - 2^ 

2. Establishes a good rapport with pupils (relaxed, — 

Informal, confident) ---- — j7 

3. Encourages all pupils to participate ~jf 

4. Instills confidence in pupils--uses positive reinforce-'"^ 
■ ment) — ...... — ..... 

Rating of teacher's self-confidence ' 12 3 4 

n * • ^ ^ 1. , . . 3 0 3' 9 

Rating of teacher's utilization of skill 12 3 4 

0, Pupil Participation 0 0 2 13 

1. Actively respond during reading period ......... 25 

2. Interact with each other —j- — 

3. Show interest in independent reading -- — ......... — ~~ 

4. Able to work indopendently with skills material ------ TF ~ 

5. Students appear to be working on individual skills ~~~ 

according to diagnosis -----^ ,5 

6. Indication by students of their awarenoss of their own *~ 

relative strengths and "saknessss in reading, ,2.5 

Degree of self - direction exhibited by students 12 3 4 

.Degree of self-confidence exhibited by students f f 3 

, . ■ 0 0 C .7 5 
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App0ndi3s B 

, ^ . . SUmBR HIGH SCHOOL HBMEDIAL READING PROGRAM 

Umbrella I 

Erik Collins, Ph.D. 
ECRC/UMES, Princess Anne, MD 218S3 

Teacher Questionnaire 

Please circle the appropriate answers, filling in information where neces 

l^J^^ sealed envelope on August 8. Neither you nor 
your school is identified, 

1. What is your present level of education? (17 ^ 16) 

a. B.A* 2 

b. M,A, 5 

c. li.k.^ $ 

2* Did you have a malor in reading at any tiine? 

a. Yes^ 2 

b , No 2 4 

3. Have you taken other specialized training in remedial reading 
(mservice^ collage, other)? ^ 



Catl&am (Graduate Studi&e) 3 
Varkshopd 4 



How many years have you taught reading 

a, in high school? 5^1^^ Md ^ B (N^is) 

b, m junior high school? ^_ 2-7^ Md ^ 6 (N^ 8) 

c, in elementary school? \ 2^s\ Md ^ S (N^ 3) 



other experience do you have in teaching reading, other than 
that listed above? 

TutQ^inq, Tegahin^ SnQliah in Junior^ H%ah Sahool. Hiah Sahoal. A l^ 
t^rnaHV F- g .? r^ , Summer' PvPt jramB. E vening PpoaT^ams , Cnll^.g^ 

Ppeparatary^, Community Oollege^ Own Children 
Do you have a separate room for your classes? 

a* Yes JJ^ c. N/A ^ 
b. No ^ 

What is the approach of this reading program in your school? 

a. individually oriented, primarily 23 

b. group oriented, primarily q 
c* both individual and group oriented, equally 3 
d. Other 
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Teacher Questionnnire 



8* How effective do you feel such an approach was in improving nctual 
reading ability? 

a. not effective j 

b. moderately effective e 

c. very effective 9 

9. How effective do you feel such an approach was in improving 
attitudes toward readi^ig? 

a. not effective 1 
h. nioderately effective 7 
c* very effective 8 

10. How comfortable were you as an individual with this approach? 

a, uncoinf ortable 2 

b, moderately comfortable 1 
very comfortable 14 

^ ■ " 

Do you feel that this course is helping students in related subjects? 

-^.w^ - " ^ " 

a* nOj not at all 0 

b* yss j but only very little 0 

c, yes J to some extent 7 
yes j quite a bit 8 

o. yes 5 a great deal 3 

12. Now that you have experience teaching this course^ how do you feel 
about it? 

a, it was unsuccessful this summer and ^ due to the framework i)] 
which you have to work, it would continue to be unsuccessful 
next summer. 0 

b. it was unsuccessful this year, but could be better next 
sunmier* 0 

€• it was successful this year and could be successful next 
summer. 16 

d, Comment Som&what Quaa&ssful; Good pTo^i^am; B&st pToavam evar. 

13. Did you receive an adequate quantity of the prescribed materials with 
which to conduct the course? 

a. Yes 14 

b. No 2 " 

14. How would you rate the quality of the materials which you liavo 
received? 



1 



g'J^ below average average above avcrago good 
(01 (1) (S) (S) (S) 

IS, Did you supplement the prescribed materials with materials from otlic 
sources? 



a- Yes 3^ 

b. NO 2 29 
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Teacher Questionnaire 
rag€ throe 



16. Did you find it necessary to create your own reading materials? 

a. Yes 3 ' 

b, Nn 13 

17* How many times did your coordinator or teacher trainer visit your 
school this summer? 

a, once ^ 

b, twice 0 
c* three time 2 

d, more than three times ^- , 

18, In total, what length of time did they spend in your school? 

l^A days One visit per we&k 

19, Did you profit from the consultatioif in terms of 

a* defining the goals of this particular program i^yes ^no 

b, gaining skill in individualized teaching techniques lOy&s 2no 

c, gaining familiarization with materials Ijyes Ino 

d, gaining confidence and a feeling of ease with the 

format of the course NA = 4 ISyes Ono 

20, How accessible and helpful was the High School Reading Office this 
= summer? 

a* very much 14 

b, so-so 2 

c, not at all 0 

21, Given the guidelines set for you, how would you rate this reading 
program? 

a, very poor 0 

b, below average 0 

c, average 2 

d, above average 7 
e * very good 8 

22, Would you want to participate in this program next year? 

a* Yes 18 
b. No 0 

23, We would vfelcome any further comments^ critlcisi^, or suggestions you 
might wish to offer: 

More Barn ell Loft r&ading matmTiats ; hire exp&rienasd paraprQf&saion j 
newspapers J paperbac kB goadj good programj testing ov&r&mphasin^d; 
3 low pay roll I ^ set up time for teaahers » 
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OFnCE OF E DUCAT lOMl EVALUATION " DA^ LOIS FCTIM 
(attach to MIR, item #30) Funetlon #09-61613 

In this tabid inter all Data 10$$ infonnation, Bitwiirt MIR, Item #30 and thii iom, all partieipinti 
in each activity suit be aceountted lor* Thi componanE anlaacivlty cedas usad in eotnplatlen of Ittm #30 
should be usad hera so that thi two tablaa roateh. Sii dtftnltlona belo^f table for fufthat ^nitructiens. 



ConponeQC 
Code 


Acclvlty 
Code 


(1) 

Group 

i.d/ 


1 (2) 

1 Test 
' Used 


(3) 
Total 
N 


m 

Number 
TiStid/ 
Analyzed 


(5) 

ParcielpanCi 
Not Tested/ 
Analyzed 


(6) 

Eaaaoni why atudinti wars mt tiitedg §t if 
tgitid^ wifi not analyitd 

Humbar/ 










N 


% 




Niaon 


6 


0 


8 


1 


6 


7 


2 


0 


16 


MAT71 


776 


63S 


.141 


18.2% 


Withdraw or digehariad from program 
Abaant from poatteit ' 


38 


NoA«Sn|llih-epa^lng 


3 



















































































































































(1) Identtfy the paftielpants by spiotfic gradt levsl pade 3p grade 9), Whift savaral gtades iri i^tiiaSp 

enter 1:h<^ laat two diglti of tha QOmpontnt aodog 

(2) Identify the test used and year of publleatlon ^iT-70| 8041-741 ate,), 

(3) Humber of partietpanti in the aetivity* 

(4) Sumber of partlelpanti included in thi pfe. and pcsttiat oaloulations found on itiitfSO, 

(5) Nusber and percent of participants not tastad mi/ot not analyEid on ittHrfSO, 

(6) Specify aU reasons why atudents wire not taatad and/or analy£ed^ tot taah reaeon ipaclfiedi provide i lepami 

^TOber count. If any further decuaintatloa 1] availabli, pleasa attaeh to this form* If ft^thtf ipiai Is 
niadid to apaoify and esgilila data loiii attaiih additional pagti to thla form. 
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